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A method and system for detecting a failure or performance 
degradation in a dynamic system having sensors for mea- 
suring state variables and providing corresponding output 
signals in response to one or more system input signals are 
provided. The method includes calculating estimated gains 
of a filter and selecting an appropriate linear model for 
processing the output signals based on the input signals. The 
step of calculating utilizes one or more models of the 
dynamic system to obtain estimated signals. The method 
further includes calculating output error residuals based on 
the output signals and the estimated signals. The method 
also includes detecting one or more hypothesized failures or 
performance degradations of a component or subsystem of 
the dynamic system based on the error residuals. The step of 
calculating the estimated values is performed optimally with 
respect to one or more of: noise, uncertainty of parameters 
of the models and un-modeled dynamics of the dynamic 
system which may be a flight vehicle or financial market or 
modeled financial system. 
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METHOD AND SYSTEM FOR DETECTING A 
FAILURE OR PERFORMANCE 
DEGRADATION IN A DYNAMIC SYSTEM 
SUCH AS A FLIGHT VEHICLE 

5 

CROSS-REFERENCE TO RELATED 
APPLICATION 

This application claims the benefit of U.S. provisional 
application Serial No. 60/280,081, filed Mar. 30, 2001. 

10 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 

This invention was made with government support under 
NASA Grant No. NGT4-52404. The government has certain 
rights in the invention. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to methods and systems for detect- 2 o 
ing failures or performance degradation in dynamic systems 
such as flight vehicles. 

2. Background Art 

FIG. 1 is a representation of the prior art, which depicts 
failure detection and isolation (i.e., FDI) of flight vehicle 25 
icing. Generally, the method of this prior art teaches detec- 
tion and isolation of failures in flight vehicles that result in 
a loss of control effectiveness. Detection and isolation of 
failures is accomplished via a linear state estimator or 
observer that continuously calculates an estimate x of the 30 
state vector x of the flight vehicle dynamic system in 
question. The flight vehicle dynamic system is assumed to 
have sensors available for measuring some or all of the state 
variables. The measured values y are normally present as 
part of the dynamic system. 35 

The state estimator calculates estimated values y of the 
sensor outputs and is designed such that for no system 
failures the estimated values y agree with measured sensor 
values y. Whenever system failures (as described above) 
occur, there is a non-zero error e difference between y and 40 

y- 

e=y-y. 

Each state estimator is designed to detect and isolate a 
particular hypothesized failure mode f. 

The feedback gains for the state estimator are chosen such 
that the error residuals for a given hypothesized failure are 
in a unique direction in output space. Isolation of the failure 
from other possible failures is done via the directionality of 
the error residuals. 

The state estimator is a linear Luenberger-type observer 
which represents a dynamic system that has dynamics 
typically given by nonlinear mathematical models. The 
dynamics are typically a linearized model of a nonlinear 
system. In this case, the models can be obtained from 
empirical measurement of dynamic system performance 
through instrumented flight test or through mathematical 
modeling of the system. The nonlinear models may be 
obtained from the above data by any of a number of standard 
regression techniques as is known in the art. 

The state estimator is an observer of the form: 

x=Ax+Bu+L (y-y) 
y=Cx+Du, 

65 

where A and B are the state transition and input matrices, 
respectively, of the nominal reference model for the system 
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dynamics, and D is the estimator gain matrix that is chosen 
such that the output error residual e=y-y is one dimensional. 
The design of the estimator gain is explained in section 2.1 
of Appendix A hereto. The nominal matrices A and B are 
obtained by linearizing the system nonlinear models at an 
operating point and are approximately valid representations 
of the dynamic system in a neighborhood of that operating 
point. Other sets of matrices are required to characterize 
flight vehicle dynamics over the entire flight envelope. 

It was previously recognized by the inventors that some 
procedure could be found for selecting operating points and 
associated neighborhoods, and representing the dynamic 
system within that neighborhood based on certain operating 
parameters for the dynamic system (e.g., flap setting angles 
for flight vehicles). This procedure is called “gain schedul- 
ing” in the prior art papers authored by the inventors. 

However, it was not known or shown in the prior art how 
to select operating points or how large the neighborhoods 
could be to achieve acceptable error levels for the FDI. 

It was also recognized in the prior art papers authored by 
the inventors and noted herein below that detection and 
isolation of hypothesized failures could be accomplished by 
examining the magnitude of error residuals along the direc- 
tion of the output of the FDI for the hypothesized failure. 

U.S. Pat. Nos. 5,615,119; 5,819,188; and 6,085,127 to Vos 
disclose fault tolerant automatic control systems utilizing 
analytic redundancy. The systems are used for controlling a 
dynamic device, preferably a flight vehicle. The systems 
include a processing structure which controls the operation 
of the systems. In operation, the processing structure trans- 
forms sensed dynamic device control criteria into a linear 
time invariant coordinate system, determines an expected 
response for the device according to the transformed control 
criteria, compares the expected response with a measured 
response of the device and reconfigures the control means 
based on the comparison. 

U.S. Pat. No. 4,355,358 to Clelford et al. discloses an 
adaptive flight vehicle actuator fault detection system. The 
system, utilizing sensors to determine the position of various 
operating devices within a flight vehicle, compares the 
positions with expected positions provided by an operating 
model of the flight vehicle. Thereafter, the system provides 
fault warnings, based upon the actual device operating 
conditions and the expected operating conditions obtained 
from the model. 

U.S. Pat. No. 5,919,267 to Urnes et al. discloses a neural 
network fault diagnostics system and method for monitoring 
the condition of a host system, preferably a flight vehicle 
including a plurality of subsystems. The system includes a 
neural network means for modeling the performance of each 
subsystem in a normal operating mode and a plurality of 
different failure modes. The system also includes a com- 
parator means for comparing the actual performance of each 
subsystem with the modeled performance in each of the 
normal and possible failure modes. Finally, the system 
includes a processor for determining, based on the compari- 
sons of the comparator, the operating condition of the host 
system. 

U.S. Pat. No. 5,070,458 to Gilmore et al. discloses a 
method of analyzing and predicting both airplane and engine 
performance characteristics. In operation, the system moni- 
tors the operation of a flight vehicle during flight and stores 
the monitored parameters and flight circumstances in a 
memory. Thereafter, during subsequent flights, the system 
determines and/or predicts how the flight vehicle should be 
operating. 

U.S. Pat. No. 4,312,041 to DeJonge discloses a flight 
performance data computer system. In operation, the system 
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monitors the operation of various operating characteristics 
of a flight vehicle during flight and provides an indication of 
the characteristics to the flight vehicle operator. The infor- 
mation provided by the system assists the operator during 
the flight. 

U.S. Pat. Nos. 5,195,046; 5,838,261; and 6,052,056 dis- 
close various systems for monitoring the performance of 
dynamic flight vehicle subsystems and providing an indica- 
tion of the performance to the flight vehicle operator. 

U.S. Pat. No. 3,603,948 discloses fault identification, 
isolation, and display device for testing a flight vehicle 
control system. The device senses malfunctions in selected 
portions of the system and provides a visual display which 
instantaneously identifies and isolates the malfunctioning 
section and memorizes the fault status of the section until the 
device is manually or automatically reset. 

U.S. Pat. No. 3,678,256 discloses a performance and 
failure assessment monitor which assesses overall perfor- 
mance of the operation of the automatic landing mode of a 
flight control system for a flight vehicle. The monitor is 
connected to various sensors throughout the flight vehicle so 
that it can compare what the flight control system of the 
flight vehicle is accomplishing during a landing maneuver 
against an independent model generated within the monitor 
of what the flight control system should be accomplishing. 
The resultant comparison is displayed to the pilot as a 
measure of relative confidence that the landing will be 
accomplished properly. The monitor also includes failure 
verification and failure reversion control for making imme- 
diate and accurate assessments of the consequence of a 
failure of any component in the flight vehicle which in any 
way affects the ability of the flight control and flight guid- 
ance instrument systems to operate properly, for correcting 
the failure when possible and for displaying only the critical 
failure information to the pilot of the flight vehicle. 

U.S. Pat. No. 5,760,711 discloses a modulated light 
source (31) which transmits light pulses via a prism (27) 
through a monofilament optical fiber light channel (20) to an 
optical sensor (10) remotely located and flush mounted to an 
aerodynamic surface (14) of the flight vehicle most likely to 
accrete ice. In the absence of ice, little to no light is reflected 
inward via the light channel. When water, ice, or de-icing 
fluid covers the light sensor, an increased amount of light 
pulses are reflected inward through the single fiber optic 
light channel and prism assembly where they are detected by 
a light detector (34) which generates an electrical output 
signal indicative of the type, amount, and rate of ice accre- 
tion. The output signal is visually displayed (37) and the 
pilot may be audibly warned. In an alternate embodiment, 
the remote light sensor (70) is fuselage mounted (72) with an 
airfoil shaped probe (71) having a clear lucite leading edge 
(73) to which is secured a pair of fiber optic light pipes 
(75,76), one for outbound (76) and the other for inbound 
(75) light pulses. This mode requires no prism assembly. All 
electronics are housed in the computerized control/display 
unit (30) other than the fiber optic cable and remote mounted 
light sensor. 

U.S. Pat. No. 5,301,905 discloses a flight vehicle icing 
detection system which detects accumulation of ice on an 
upper surface (12) of a wing (10) of a flight vehicle. The 
system includes an air pump (18) that delivers air through 
first and second conduits (24,26). The first conduit delivers 
air through a first air knife (32) to openings (34) in the upper 
surface of the wing. The second conduit delivers air through 
a lower wing surface (14) through openings in a second air 
knife (42). When ice accumulates on the upper surface, flow 
from the first air knife is restricted. A differential pressure 
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sensor (46) senses a pressure difference between the con- 
duits and warns the pilot of possible ice accumulation by 
illuminating a warning light (50). 

The reference IFAC World Congress, “Parameter Identi- 
5 fication for Inflight Detection of Aircraft Icing”, July 1999, 
discloses the use of signal processing to detect icing using 
online parameter estimation. The reference identifies a new 
model and compares it to a baseline model, rather than 
looking only for a change in the baseline model. 

10 The following papers authored by the inventors of this 
application are relevant and are hereby incorporated in their 
entirety herein: 

William Ribbens and Robert H. Miller, “Detection of Icing 
15 and Related Loss of Control Effectiveness in Regional 
and Corporate Aircraft”, AVIATION CONFERENCE, 
SAE, 1999; 

Robert H. Miller and William B. Ribbens, “Detection of the 
Loss of Elevator Effectiveness Due to Icing”, Number 
20 99-0637, 37TH AEROSPACE SCIENCES, AIAA, Janu- 

ary 1999; and 

Robert H. Miller and William B. Ribbens, “The Effects of 
Icing on the Longitudinal Dynamics of an Icing Research 
Aircraft”, Number 99-0636, 37TH AEROSPACE 
25 SCIENCES, AIAA, January 1999. 

Fault detection theory and other background material can 
be found in Appendix A hereto. 

SUMMARY OF THE INVENTION 

30 An object of the present invention is to provide an 
improved method and system for detecting a failure or 
performance degradation in a dynamic system such as a 
flight vehicle. 

35 In general, performance degradation means a very small 
but statistically significant change in a parameter or group of 
parameters in a mathematical model of the system. 

In carrying out the above object and other objects of the 
present invention, a method for detecting a failure or per- 
40 formance degradation in a dynamic system having sensors 
for measuring state variables of the system and providing 
corresponding output signals in response to at least one 
system input signal is provided. The method includes cal- 
culating estimated gains of a filter and selecting an appro- 
45 priate linear model for processing the output signals based 
on at least one system input signal. The step of calculating 
utilizes at least one model of the dynamic system to obtain 
estimated signals. The method also includes calculating 
output error residuals based on the output signals and the 
5Q estimated signals. The method further includes detecting at 
least one hypothesized failure or performance degradation of 
a component or subsystem of the dynamic system based on 
the error residuals. The step of calculating the estimated 
gains is performed optimally with respect to one or more of: 
55 noise, uncertainty of parameters of the at least one model 
and un-modeled dynamics of the dynamic system. 

The step of calculating estimated gains may be performed 
continually. 

The dynamic system may be a closed-loop dynamic 
60 system. 

The method may further include generating a signal for 
each hypothesized failure or performance degradation and 
storing each signal in a database for subsequent retrieval. 
The method may further include generating a signal for 
65 each hypothesized failure or performance degradation and 
processing each signal to diagnose the at least one hypoth- 
esized failure or performance degradation. 
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The method may further include generating a signal for 
each hypothesized failure or performance degradation and 
processing each signal to obtain a reconfiguration signal. 

The dynamic system may have a controller wherein the 
method may further include reconfiguring the controller 
based on the reconfiguration signal to compensate for the at 
least one hypothesized failure or performance degradation. 

At least one hypothesized failure or performance degra- 
dation may be a failure or degradation of one of the sensors. 

The reconfiguration signal may insert an estimated or 
compensated value of the output signal of the failed or 
degraded sensor into the controller. 

The dynamic system may have a controller and at least 
one actuator wherein the method may further include recon- 
figuring the controller based on the reconfiguration signal to 
compensate for a change of the at least one actuator. 

The dynamic system may be a flight vehicle and the 
sensors may include flight control sensors. The dynamic 
system may also be a financial market or a modeled financial 
system. 

The dynamic system may be a physical system charac- 
terized by a nonlinear dynamic model having parameters. 
The changes in the dynamic system may be manifest by 
parameter changes in the nonlinear dynamic model. 

The error residuals may be propagated in a unique direc- 
tion in output detection space for a given hypothesized 
failure or performance degradation. 

The step of calculating estimated gains may include the 
step of controllably selecting parameters of the at least one 
model. 

The step of detecting may detect intermittent faults and 
may be based on magnitude and direction of the error 
residuals in the detection space. 

At least one model may include non-dimensional vari- 
ables wherein the step of detecting may include the step of 
converting from the non-dimensional variables to dimen- 
sional variables to obtain re-scaled error residuals and 
wherein the step of detecting is also based on the re-scaled 
error residuals. 

A plurality of mathematical models may be utilized to 
model the dynamic system wherein the step of calculating 
estimated gains may include the step of selecting one of the 
plurality of mathematical models. 

Further in carrying out the above object and other objects 
of the present invention, a detection system for detecting a 
failure or performance degradation in a dynamic system 
having sensors for measuring state variables of the dynamic 
system and providing corresponding output signals in 
response to at least one system input signal is provided. The 
detection system includes means for calculating estimated 
gains of a filter and choosing an appropriate linear model for 
processing the output signals based on the at least one input 
signal. The means for calculating utilizes at least one model 
of the dynamic system to obtain estimated signals. The 
system further includes means for calculating output error 
residuals based on the output signals and the estimated 
signals. The system also includes means for detecting at 
least one hypothesized failure or performance degradation of 
a component or subsystem of the dynamic system based on 
the error residuals. The means for calculating the estimated 
gains calculates optimally with respect to one or more of: 
noise, uncertainty of parameters of the at least one model 
and un-modeled dynamics of the dynamic system. 

The estimated gains may be calculated continually. 

The dynamic system may be a closed-loop dynamic 
system. 
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The detection system may further include means for 
generating a signal for each hypothesized failure or perfor- 
mance degradation and a database for storing each signal for 
subsequent retrieval. 

5 The detection system may further include means for 
generating a signal for each hypothesized failure or perfor- 
mance degradation and means for processing each signal to 
diagnose the at least one hypothesized failure or perfor- 
mance degradation. 

10 The detection system may further include means for 
generating a signal for each hypothesized failure or perfor- 
mance degradation and means for processing each signal to 
obtain a reconfiguration signal. 

5 The dynamic system may have a controller and the 
detection system may further include means for reconfigur- 
ing the controller based on the reconfiguration signal to 
compensate for the at least one hypothesized failure or 
performance degradation. 

20 At least one hypothesized failure or performance degra- 
dation may be a failure or degradation of one of the sensors. 

The reconfiguration signal may insert an estimated or 
compensated value of the output signal of the failed or 
degraded sensor into the controller. 

25 The dynamic system may have a controller and at least 
one actuator and the detection system may further include 
means for reconfiguring the controller based on the recon- 
figuration signal to compensate for a change of the at least 
one actuator. 

30 The dynamic system may be a flight vehicle and the 
sensors may include flight control sensors. The dynamic 
system may also be a financial market or modeled financial 
system. 

35 The dynamic system may be a physical system charac- 
terized by a nonlinear dynamic model having parameters 
and the changes in the dynamic system may be manifest by 
parameter changes in the nonlinear dynamic model. 

The error residuals may be propagated in a unique direc- 

40 tion in output detection space for a given hypothesized 
failure or performance degradation. 

The means for calculating estimated gains may include 
means for controllably selecting parameters of the at least 
one model. 

45 The means for detecting may detect intermittent faults. 

The means for detecting may detect based on magnitude 
and direction of the error residuals in the detection space. 

At least one model may include non-dimensional vari- 

5Q ables and the means for detecting may include means for 
converting from the non-dimensional variables to dimen- 
sional variables to obtain re-scaled error residuals and the 
means for detecting may detect based on the re-scaled error 
residuals. 

55 A plurality of mathematical models may be utilized to 
model the dynamic system and the means for calculating 
estimated gains may include means for selecting one of the 
plurality of mathematical models. 

In general, the method of designing or calculating the 

60 filter gains is based upon a optimization problem solving 
linear matrix inequality optimization problem with a subset 
of the eigenstructure specified. The optimization metric can 
be based upon minimizing the variance, the maximum 
deviation, the infinity norm, or any quadratic or linear cost 

65 function. 

The above object and other objects, features, and advan- 
tages of the present invention are readily apparent from the 
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following detailed description of the best mode for carrying 
out the invention when taken in connection with the accom- 
panying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a prior art dynamic system 
and system for detecting and isolating failures in the 
dynamic system; 

FIG. 2 is a block diagram of a dynamic system and a 
gain-scheduled FDI constructed in accordance with the 
present invention to obtain error residuals; 

FIG. 3 is a block diagram of a decision logic subsystem 
which utilizes the error residuals obtained in FIG. 2 to 
generate a binary failure signal and a warning signal; 

FIG. 4 is a block diagram of a subsystem which utilizes 
the binary failure signal obtained in FIG. 3 to generate a 
signal which can be utilized by the two controllers of FIG. 
2, to store the failure signal in a failure or degradation log 
and to provide a diagnosis of the failure or degradation; and 

FIG. 5 is a block diagram flow chart illustrating an 
algorithm for designing a filter of the present invention as 
explained in detail in Appendix B. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

FIG. 2 is a block diagram of an embodiment of the present 
invention. Implicit in this block diagram is the generaliza- 
tion of the prior art method to all major components of a 
flight vehicle control system, including the control surfaces 
(part of the dynamic system block), actuators, sensors and 
the electronic control system itself. Furthermore, this block 
diagram depicts a general dynamic system (not just a flight 
vehicle) that can be any system characterized by nonlinear 
dynamic models such as a financial system modeled using 
the principles of econometrics and mathematics (e.g., a 
model of the stock market). 

The present invention is similar to the prior art in that it 
employs a gain-scheduled state estimator to detect failures in 
a dynamic system (for which a flight vehicle is a special 
case) and that the state estimator gains are designed to 
propagate error residuals in a unique direction in output 
space for a given hypothesized failure. In the prior art, 
detection and isolation of flight vehicle pitch control is done 
with a simple amplitude comparison of the error residual 
magnitude along the hypothesized failure. While the prior 
art teaches detection and isolation of sensor failures, the 
prior art is only applicable to systems characterized by linear 
dynamic models. In particular, the method of the present 
invention would not be applicable to flight vehicle control 
sensors since the relevant models have substantial nonlin- 
earities. Errors associated with a linear FDI would not yield 
acceptable performance for finding errors in flight vehicle 
control sensors. 

Significant advances over the prior art are made in the 
present invention as embodied in FIG. 2. In this Figure, the 
specific components and/or subsystems of the present sys- 
tem of detecting and isolating failures are shown. Also 
depicted in FIG. 2 is an FDF controller that is responsible for 
setting the state estimator parameters including the state 
transition matrix A, the input matrix B, and the gain matrix 
L. 

The block diagram of FIG. 3 shows a set of components 
incorporated in a decision logic block specifically showing 
advances over the prior art. These advances include optimal 
signal processing in the form of an optimal filter and vector 
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product operations, resealing calculations and two-step 
detection logic (as compared to prior art simple threshold 
comparison of amplitude). 

The block diagram of FIG. 4 depicts separate blocks for 
5 functions that are not anticipated in the prior art, including 
control reconfiguration and diagnostic fault tree analysis that 
is applicable, for example, to detecting and isolating inter- 
mittent faults. The diagnostic function has been considered 
in the prior art, but only in the sense of a gradual 
io deterioration/degradation of performances of a component 
or subsystem. The potential for detecting intermittent faults 
is not found in the prior art. 

As shown in FIG. 2, the present invention operates by 
generating output error residuals whenever there is a change 
15 in the dynamic system from the nominal system. Changes in 
the dynamic system are manifest by parameter changes in 
the non-linear dynamic model that characterizes its perfor- 
mance. The gain scheduled FDI block responds to these 
changes by generating an output (error residual) that, in a 
20 real sense, is a “signature” for the hypothesized failure 
event. 

The dynamic system depicted in FIG. 2 includes a plant 
(e.g., flight vehicle), sensors, actuators, and a controller. The 
dynamic system as depicted in FIG. 2 is in the form of an 
25 electronically-controlled plant having feedback of plant 
variables via the sensors to the controller. A dynamic system 
having this structure is often referred to as a closed-loop 
system, whereas the plant by itself (which is a dynamic 
system) is often termed an open loop dynamic system. The 
present invention is equally applicable for detecting and 
isolating failures in open loop or closed-loop dynamic 
systems. 

A change in a component or subsystem of a given 
35 dynamic system (constituting a failure or partial failure or 
degradation) yields a change in the output of one or more 
sensors from its nominal condition. The state estimator 
matrices (A, B, C, D, L) calculate the state of the nominal 
system and, using the nominal sensor models, generates the 
40 outputs y that the dynamic system sensors should have in the 
absence of a failure. The difference between actual y and 
nominal y constitutes the error residuals, e, associated with 
a given hypothesized failure. 

The state estimator matrices (A, B, C, D, L) are supplied 
45 by the FDF controller block (e.g., via table look-up) to the 
state estimator based upon the nominal operating point of 
the dynamic system. The nominal operating point is char- 
acterized by system configuration and average values of 
certain variables. In the example of a transport category 
50 flight vehicle, the nominal operating point might include 
trailing edge, leading edge, flap settings, landing gear 
position, trim settings for control surfaces, thrust levels and 
approximate speed setting. The process of setting state 
estimator matrices as a function of nominal operating point 
55 is known as gain scheduling. 

The possibility of gain scheduling is only mentioned 
briefly in one of the above-noted papers authored by the 
inventors. Only with the description of the present invention 
in the present application is gain scheduling employed for 
60 setting the state estimator matrices in great detail. 

According to the prior art, a sub -optimal state estimator 
can be designed by assigning the poles of its closed-loop 
transfer function by well known prior art methods summa- 
rized in section 2.1 of Appendix A. The state estimator 
65 eigenstructure associated with the detection space is 
uniquely specified by the directionality requirement of the 
output error residuals. In the prior art, the remaining poles 
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associated with the so-called completion space can be 
assigned arbitrarily in the left-half of the complex plane. 

The method of the present invention uses linear matrix 
inequalities (LMI) to assign the poles and unspecified eigen- 
structure of the estimator closed-loop transfer function, 5 
thereby yielding the desired feedback gain L. (See, Appen- 
dix B entitled “Optimal Failure Detection Filters/’). The 
design method based upon LMI for design of a state esti- 
mator is not found in the prior art. 

One of the important issues in the design of any FDI is its 10 
robustness to noise, model parameter uncertainty and 
unmodeled dynamics. The LMI method of designing an FDI 
as illustrated in FIG. 5 and as used in the present method and 
system has improved robustness over prior art methods of 
design. As noted in Section 5.2 of Appendix B, the norm of 15 
the sensitivity function S is less than or equal to 1: 

lispi. 

Another advance of the present method of detecting and 2Q 
isolating failures in a dynamic system is in the post-FDI 
detection process. A basis for this multi-step process comes 
from the basic nature of the system dynamic models. It is 
well known to one of ordinary skill in the art that it is 
common practice in aerospace applications to write the 25 
system dynamic equations (i.e., the model) in terms of 
non-dimensional variables. It is also possible to express, the 
system model in dimensional variables. Either modeling 
method yields equivalent results except that there are 
numerical benefits in choosing one method over another. In 3Q 
the present invention, the use of both modeling methods 
provides the opportunity to optimize signal/noise at the 
detection stage. The method of using both dimensional and 
non-dimensional modeling can substantially reduce error 
rates of detection and isolation relative to prior art methods. 35 
The method of converting from non-dimensional to dimen- 
sional variables is referred to herein as “resealing,” as shown 
in FIG. 3. 

Moreover, the present method is an advancement over the 
prior art by its combined use of error magnitude and 4Q 
direction in output space. The present method obtains a 
scalar metric of the output error residual vector (in an n 
dimensional vector space): 

( < e, CDf ) *c 

where: 

e=output error residual from the state estimator; 

C=output matric (sensor model); 

D .^detection space 

||CDj,||=norm of the detection space (hypothesized 
failure); and 

||e||=norm of the error residual. 55 

The FDI of the present invention declares that the hypoth- 
esized failure of the dynamic system has occurred when both 
the angle and magnitude of the error residuals satisfy the 
desired criteria. These criteria are specific to a given 
dynamic system and the associated process and measure- 60 
ment noise. 

In addition to the improvements in the design of the FDI 
and post-FDI signal processing and detection methods of the 
present invention over the prior art, the present invention 
anticipates numerous applications not heretofore found in 65 
the prior art. The present invention can be utilized in the 
diagnosis of dynamic system problems that have not previ- 
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ously been tractable. For example, the diagnosis of inter- 
mittent faults has long proven to be a challenge to mainte- 
nance technicians. Problems of this nature are well known to 
automobile owners in the form of problems that occur on the 
road but refuse to be present in the repair shop. 

The present invention can be used to diagnose these 
intermittent faults. A suitably designed FDI operating con- 
tinuously when the dynamic system is operating will detect 
the hypothesized failure whenever it occurs. In the present 
invention, the decision logic subsystem of FIG. 3 has a 
binary-valued failure output signal or signature F, that is 
false (e.g., zero) whenever the system has no failure and is 
true (i.e., one) whenever the failure is present. 

This binary failure signature is sent to a database with a 
log or “failure log” as shown in FIG. 4 which consist of a 
non-destructive memory and an internal real-time clock. The 
time of occurrence, duration and nature of the failure are 
stored in memory for later examination by maintenance 
technicians. The implementation of the failure log itself is 
well known to one of ordinary skill in the art. A separate 
failure binary signal F is provided for each hypothesized 
failure. 

The block diagram of FIG. 4 depicts a sub-block labeled 
“diagnostic fault tree and logic.” The output of this block is 
connected to the failure log sub-block via a multi-bit digital 
link H. The diagnostic fault tree sub-block has the capability 
for some real-time diagnosis of failures. This latter block can 
be brought into play whenever multiple failure signatures 
(i.e., F) have occurred. It is well known to one of ordinary 
skill in the art (of dynamic system design or of maintenance) 
that multiple failures are often symptoms of a larger system 
failure (e.g., power supply). A systematic diagnosis proce- 
dure (often called a “fault tree” and well known to mainte- 
nance technicians) can be used to diagnose such a system 
failure. 

Another advance of the present invention over the prior 
art is depicted in the sub-block of FIG. 4 labeled “recon- 
figuration logic and computation.” In certain cases, it is 
possible to compensate for a given failure by a reconfigu- 
ration of the dynamic system controller. For example, the 
failure of one sensor (in a multi-sensor control 
configuration) often has compensation in the form of data 
from the other sensors. It is often possible to estimate the 
output of the failed sensor via the state estimator. Acceptable 
(though suboptimal) dynamic system performance is often 
achievable by substituting the estimated sensor value for the 
failed sensor signal in the control system, as shown at signal 
Gin FIG. 2. 

In addition, if is often possible to compensate (at least 
partially) for an actuator calibration change. The desired 
input to the plant can often be achieved by varying the 
electrical signal to the actuator to achieve the desired plant 
input (e.g., elevator or rudder actuator for a flight vehicle). 
Although control reconfiguration is known in a limited sense 
in the prior art, the use of an optimal FDI for determining the 
magnitude of the failure and for yielding the relevant 
compensation is new in the present invention. 

As previously noted, the dynamic system could be a 
model of a financial system such as the stock market. The 
above-described filter would monitor the financial system 
and alert the user(s) (i.e., owner(s), seller(s), buyer(s), etc.) 
of options, futures or any other kind of financial instrument 
whose value is based upon the inputs, outputs, and/or system 
parameters of a change. The system would alert the user to 
the change and in what part of the mathematical model the 
change occurred. 

For the convenience of the reader, appendices A and B, 
provided herein below, review and summarize the theory of 
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FDI and the design of failure detection filters as well as 
provide background material for understanding the theoreti- 
cal concepts involved in the present invention. This theory 
provides support for and proof of many assertions made in 
the main body of the specification. 5 

On the other hand, it should not be necessary to follow all 
of the discussion in these appendices to understand the 
invention itself or its applicability in practice. 

Appendix A 10 

Fault Detection Theory and Background Material 

This Appendix contains definitions and results used 
throughout the application. The treatment of this material is 
not exhaustive. 15 

2.1 Failure Detection and Isolation Theory 

The original theoretical development of detection filters 
was done by Beard and Jones in the late 1960s and early 
1970s. Since then, some major researchers have studied the 
problem: 20 

Chow and Willsky studied robustness issues in detection 
filters. 

White and Speyer reformulated the system as an eigen- 
system assignment problem. 25 

Massoumnia reformulated Beard’s and Jones’s work in a 
geometric context. 

Min and Ribbens solved the sensor failure isolation 
problem. 

Park and Rizzoni reformulated the problem as a 30 
decoupled observer problem. 

Analytic redundancy management algorithms are devel- 
oped by forming and processing failure residuals. These 
residuals are essentially zero if no failure has occurred and 
are non-zero if a failure is present. FDI filters constitute one 35 
form of an analytic redundancy management algorithm. FDI 
filters are linear filters with directional characteristics that 
can be readily associated with some known failure mode. 
Like all linear filters, FDI filters are model-based. Consider 
the open loop system model free of sensor failures, 4 

x=Ax+Bu, ( 2 . 1 ) 
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where f £ is the nxl failure direction associated with the ith 
failure, n,- is generally a time-varying scalar function of x(t) 
or u(t). For instance, a reduction in the control authority of 
an actuator could easily be modeled as a -Abu(t) term. 
Another common failure is a trim change in nonlinear 
systems where a linearized model is being used. In this case, 
the failure would be B(u(t)-u mm ). A priori knowledge of n,- 
is not required, and n,- is generally assumed to be an arbitrary 
function of time. Sometimes the magnitude of n,- is estimated 
to gauge the severity of the failure or to attempt to distin- 
guish between two failures that are not output separable; 
output separable will be defined later. Bear stated the fol- 
lowing definition. 

Definition 2.1.1 (Detection Gain) 

The fault associated with f £ in the system described by 
(2.7) is detectable if there exists a nxm matrix, L, referred 
to as a detection gain for f £ which satisfies the following two 
conditions: 

1. CE maintains a fixed direction in the output space. 

2. All eigenvalues of (A-LC) can be arbitrarily specified, 
up to conjugate symmetry. 

This means the output direction is maintained during the 
transient and steady-state phase of the response due to the 
system failure. 

Lemma 2.1.1 (Unidirectional Error Output) 

Condition 1 of Definition 2.1.1, is satisfied if and only if: 

mnk[ Cf b fr-LQf b ■ ■ ■ , (A-LCy-'f^l. (2.8) 

From this it is clear that e lies in the controllable subspace 
of r,-, Wjy 

W ir R(\i h (A-LC)i h . . . ( 2 . 9 ) 

Lemma 2.1.2 (Output Separability) 

If 

. . . , cf r l ( 2 . 10 ) 


y=Cx+Du ( 2 . 2 ) 

where x is a nxl state vector, u is a pxl input vector, and y 
is a mxl measurement vector. Assuming the system is 
detectable, the detection filter then has the form of linear 
filter 

x=Ax+Bu+L(y-y), ( 2 . 3 ) 

y=Cx+Du, ( 2 . 4 ) 

where x is the state estimate and L is the detection gain. If 
the state error is defined as e^x-x, then L can be chosen such 
that the output error e=y-y, has certain directional properties 
in the presence of a failure. When there are no failures, the 
closed-loop system becomes 

'<l={A-LC)<l. ( 2 . 5 ) 

The occurrence of a plant, actuator, or sensor failure can 

usually be modeled by a single term added to (2.1) to 

produce 

x=Ax+Bu+f l n i , ( 2 . 6 ) 

( 2 . 7 ) 


is rank r, then the failures are output separable. If Ca jfi = 0 for 
j = 0 , 1 , . . . , 6-1, then the rank of CF will be <r, but if 
CA^^O, then all rank of CF equals r assumptions and 
procedures can still be used if is replaced everywhere by 
A 6 /,-. Furthermore, the dynamics of the system may still 
allow for the detection of the failures if the output separa- 
bility assumption is not satisfied because two failure direc- 
tions have identical output directions. One or both of the 
original directions can be replaced by for some j>0 such 
that rank requirement is satisfied. 

The next important concept is that of the detection 
generator, g,. It is a vector that is associated with ,f ; and is 
important in the design of detection filters. It is defined in the 
following lemma. 

Lemma 2.1.3 (Detection Space Vector) 

If 

1. (A, C) is an observable pair 

2. rank CW f ~l 

where is defined by (2.9), then there exists an n-vector, 
g-, in the controllable space of f £ (with respect to (A-LC)) 
such that 


45 


50 


55 


60 


65 


y=Cx+Du, 
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C 

CA 


gi = 0 


CA k ~ 2 


and 


CA k ~ l gi * 0 . 


( 2 . 11 ) 


5 


( 2 . 12 ) 

10 


(2.12) guarantees that the invariant space generated by g,- 
is of dimension k. Thus, the set of vectors g,-,Ag . . . ,A^ _1 gi 
form a basis for the controllable space of f £ . These facts 
yield 

[ gi (A-LC) gi , . . . ,{A-LCf-^MgiAgi, ■ ■ ■ (2.13) 


Thus, f £ can be expressed as: 


f i =ai gi +a 2 A gi + . . . +a k A k 1 gi (2.14) 2 0 

for some set of scalars ... , a k . A convenient choice for 
g; is such that the term with the highest power of A has a 
coefficient of 1. In general, if for some non-negative integer 


CA j fi = 0 for j=0, . . . , jll-1 

(2.15) 

CA^j>0 

(2.16) 

then 


for j=0, . . . , p-1 

(2.17) 

a k 

(2.18) 


and let g £ be taken so that a k _ =1. The fact that (A, C) is 35 
observable guarantees that (2.15) and (2.16) are true for 
some ju=k-l. Thus, 


fi =a igi +a Agi+ ■ ■ ■ +a k _ 1 A k - 2 gi +A k - 1 g i if Cj> 0 (2.19) 

or 40 

fi =a igi +a Agi + ■ ■ ■ +<**-„-! A k -^ 2 gi+ A k -^ gi ( 2 . 20 ) 

Definition 2.1.2 (Detection Generator) 

A vector g ,-E R”* z , satisfying (2.11), (2.12) and either 45 
(2.19) or (2.20) is defined to be the kth order detection 
generator for f £ . 

Lemma 2.1.3 shows that there always exists a detection 
generator associated with a detection gain. As an example, 
take the following system: 50 


0 3 4 

o 

o 

1 ' 

1 2 3 

,c [ 0 0 1 J’ ^ 

-0.5 

.0 2 5. 


. 0.5 . 


The detection space has dimension 1 and the detection 
generator is: 


g = 


1 

o 

o 


( 2 . 22 ) 60 


When a detection generator exists, then it will be shown that 65 
it is possible to write a solvable equation for L, the estimator 
gain. Furthermore, it allows the arbitrary specification of k 
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eigenvalues of (A-LC), where k is the order of the detection 
generator. Computing the detection generator will be dis- 
cussed later. 


Lemma 2.1.4 (Detection Gain) 

If the conditions of Lemma 2.1.3 are satisfied, and the k 
eigenvalues of (A-LC) associated with the controllable 
space f £ are given by the roots of: 


+p/ ( s k ■*■+ . . . +P 2 S+P 1=0 (2.23) 

where p,- are scalars and s is a complex variable, then L must 
be a solution of: 

LC A k ~ 1 gi =p lgi +p 2 A gi + . . . +p k A k ~ 1 gi +A k gi (2.24) 

where g,- is the kth order detection generator for f £ . 
Conversely, if there exists a kth order detection generator, g,-, 
then any solution of (2.24) is a detector gain for f £ , and the 
k eigenvalues of (A-LC) will be given by the roots of (2.23). 
Pre-multiplying (2.19) by C yields: 

CA^g-Cf, (2.25) 

which results in 

LCf~p lgi +p 2 A gi + . . . +p k A k ~ 1 gi +A k gi (2.26) 

as the equation for a detector gain when C .fhd i^0. If Cf^O, 
then pre-multiplying by CA“ yields: 

CA^-CA^fi (2.27) 

which results in 

LC-A^f~p lgi +p2A gi + . . . +p k A k ~ 1 gi +A k gi (2.28) 

for the detection gain. It can be seen that the case of Cf^O 
is a special case with /u=0 . For the following results, if 
Cf~0, just replace Of, by CA u f £ , and the results will hold. 
The following lemma then allows one to solve for the 
detection gain, L, given a detection generator, g,-. 

Lemma 2.1.5 (Detection Gain Solution) 

If D, S, and Q are matrices of dimension nxm, mxr, and 
nxr, respectively, where n^m^r and ranks =r, then the 
general solution of DS=Q, is given by: 

D=0S + +£[/-SS + ] (2.29) 

where E is an arbitrarynxn matrix and S + =(S :r S) _1 S :r . E[I- 
SS + ] represents the freedom left in D after satisfying DS=Q. 
Then, a general solution for L is: 

L=[p lgi +pA gi + ■ ■ ■ +pA k ~ 1 gi+ Ak gM c fi) Tc fir 1 ( c fi) T+L V- 

{cnmd T cn~\cn T ) (2.30) 

Then for a given L 


A-LC=A-([p lgi+ . . . +A A gJ((Cf j) -1 (Cf j) t )C+L '(/- 


(cmm T m-\cmc (2.31) 

=A'-L'C (2.32) 

where 

^'=A-big/+P2 / '&+ • • • +P,A t - 1 gi+ At giM c f if c f if 1 

(Cf g C (2.33) 

and 

cHHcmcn T cfd-\cmc ( 2 . 34 ) 


The (A'-L’C) in (2.32) has satisfied condition 1 for the 
detectability of f £ . To completely satisfy both conditions for 
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the detectability of f £ , there must be enough freedom in L' 
left to specify the remaining n-k eigenvalues of (A'-L'C 1 ). 

Lemma 2.1.6 (Eigenvalue Placement) 

If A', C', and L' are real matrices of dimension nxn, mxn, 
and nxm, respectively, the number of eigenvalues of [A'- 
L'C'] which can be arbitrarily specified by the choice of L' 
is equal to q', where 


= rankM = rank 


a 

C'A' 


C'A" 


16 

Another view of the detectability of f £ as previously 
defined is the ability to assign f £ as an eigenvector of the 
error dynamics. 


(2.35) 10 


(A-LC)f=kf t 

LCf=Af r kfi 


(2.38) 

(2.39) 


Using Lemma 2.1.5 and equation (2.39) a solution 
for L is: 


15 The closed-loop then becomes: 


(2.40) 


Moreover, for any L', the remaining (n-q') eigenvalues of 
[A'-L'C] are equal to the corresponding eigenvalues of A'. 

Then, the total number of eigenvalues that can be placed 
with the detector gain L is k+q'. Condition 2 of definition 
2.1.1, the detectability of f £ , will only be satisfied if k+q'=n. 
Since A' depends on g £ , it would follow that q' and M must 
depend on the generator g,-. The following lemman shows 
this is not the case. 

Lemma 2.1.7 (Detection Gain Eigenvalue 
Placement) 


A-LC=A-(^l r ^(Cl i ) + +£(/-(C^(Cl i .) + ))C (2.41) 

=A-L l C-EC l (2.42) 

=A i -EC i (2.43) 

where 

Lr(Afr*fXCfF (2.44) 

CHHCmcmc (2.45) 


20 


25 


If L is constrained to be a detector gain for f £ , then the 
number of eigenvalues of A=LC which can be arbitrarily 
specified, in addition to those given by (2.23), is equal to 


rankM = rank 


C 

C’K’ 


(2.36) 


A~A-((Af r kl)(Cf^)C (2.46) 

30 This allows a more direct definition of the detection space 
based on just A, C, and f £ . 


Lemma 2.1.8 (Detection Space Collinear Vectors) 


c'K' 


35 Let w be an eigenvector of A,-. If Cw is collinear with Cf £ , 
then w is in the detection space. 


where C' is defined in (2.34) and 

K'=A-A5 i {{C^ T Cn-\cn T C. (2.37) 

K' and C' do not depend on g,- or k. The amount of freedom 
left in L to place the remaining eigenvalues is always the 
same regardless of the choice of the detection generator. The 
amount of freedom depends only on (A, C). Thus, if a 
detection generator of order n-q' can be found, then the 
requirements for the detectability of f £ will be satisfied. 

Definition 2.1.3 (Detection Space) 

The null space of M is defined to be the detection space 

of fi> D.f. 

Definition 2.1.4 (Completion Space D) 

The completion space, D^-, is the range space of M. 
Definition 2.1.5 (Detection Order) 

The dimension of the detection space for f £ is defined to 
be the detection order of f £ . 

Definition of 2.1.6 (Detection Space Generator) 


Lemma 2.1.9 (Detection Space Unobservable 
Vectors) 

For (A-, C z ), which has v z unobservable eigenvalues, let 
u 1? u 2 , . . . , u vi be the v £ eigenvectors of A,- associated with 
the observable eigenvalues. Then, Cu £ is collinear with Cf £ . 

Detection Filter Design Example 

The design of a FDI for a 3x3 system with a fault vector 
with a one-dimensional detection space is considered to 
demonstrate the concepts introduced so far. This design 
example is the same that Beard and White used. Consider the 
following system, 


0 3 4 

o 

o 

1 ■ 

1 2 3 

O 

ll 

o 

o 

II 

-0.5 

.0 2 5. 


. 0.5 . 


The detection space is: 


40 


45 


50 


55 


A detection generator for f £ whose order is equal to the 
detection order of f £ is defined to be the maximal detection 60 
generator for f £ . 

The reference Beard proved the following theorem. 


-0.816 


0.408 


-0.408 


(2.48) 


Theorem 2.1.1 (Detection Space Generator 
Existence) 

If (A, C) is an observable pair, then every n-vector f £ has 
a maximal detection generator and it is unique. 


Choosing a closed-loop pole of -8 for the detection space 
and using the formulas in (2.44), (2.45), and (2.46) with f 
replaced by g results in: 
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0 

11.5 

-.45' 


ro 0.5 

0.51 

-8.5 

8.5 ' 

At = 

1 

-0.5 

5.5 

, Ci = 


I ■ — 

2.5 

-2.5 





Lo 0.5 

0.5 J’ " 




.0 

7.5 

-0.5. 




-5.5 

5.5 . 
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Lemma 2.2.1 (Invariant Subspace Basis) 


Let X be an invariant subspace of A, and let the columns 
of X form a basis for X. Then, there is a unique matrix L 
such that 


(2.14) states that f can be replaced by g without any loss 
of generality. The remaining eigenvalues can be adjusted 
using the place function in MATLAB and A- and C i for the 
system matrices. By choosing two additional poles, the gain io 
returned by the place command, L p , can be added to the first 
gain, L,-, to achieve the desired closed-loop properties. The 
final gain then becomes, 

L = L\C + L p Ci, (2.50) 15 


AX=XL. (2.60) 

The matrix L is the representation of A on X with respect 
to the basis X. In particular, (v,L) is an eigenpair of L if and 
only if (Xv,L) is an eigenpair of A. 

Lemma 2.2.2 (Left Invariant Subspace) 

The subspace X is a left invariant subspace of A if 


LC = 


0 23 40 
0 11 6 
0 2 13 


(2.51) 


XA<=X. 


(2.61) 


Furthermore, if the columns of X are linearly independent 
and the columns of Y space R _L (X), the R(X) is an invariant 
20 subspace of A if and only if 


which results in the following closed-loop system: 


y h ax= o. 


(2.62) 


A - LC = 


0 -20 -36 

1 -9 -3 

0 0-8 


with the following eigenvectors, 


v = 


1.91 1.73 0.816 

0.383 0.433 -0.408 
0 0 0.408 


and eigenvalues 


-4 0 0 ' 

0-50. 
0 0-8 


2.2 Linear Algebra Results 

Definition 2.2.1 (Ranges Spaced) 
The range space of AEC nxn is, 


(2.52) 


(2.53) 


25 


30 


In this case R(Y) is a left invariant subspace of A. 

Definition 2.2.4 (Moore -Penrose Generalized 
Inverse) 

Let AEC nxn . If A is nonsingular, then there is a unique 
matrix X such that 


AX=XA=I. 


(2.63) 


(2.54) 


It is necessary to generalize the idea of an inverse to the 
case where A is singular or even fails to be square. The 
following four conditions are known as the Penrose 
conditions, 

1. AXA=A, 


2. XAX=X, 

40 3. (AX)^=AX, 

4. (XA)^=XA. 

A matrix X which satisfies all four conditions is denoted 
A f , and is called the Moore -Penrose Generalized Inverse. 


Theorem 2.2.1 (Projection Theorem) 


R(A)={Ax:xcX}. (2.55) 

The R(A) is the span of the columns of A. 
The range of A^EC nxn is 

R(A h )={A h x:x<lX], (2.56) 

and is also referred to as the row space of A H . 

Definition 2.2.2 (Null Spaces) 

The null space of AEC nxn is, 

JV(A)={x:Ax=0}. (2.57) 

The null space of A // EC nxn is, 

N{A h )={x:A h x= 0}, (2.58) 

and is also referred to as the left null space of A. 

Definition 2.2.3 (Invariant Subspace) 

The subspace X is an invariant subspace of A if 


For any matrix A, 

1. P A =AA f is the orthogonal projector onto R(A), 

2. P A w=A f A is the orthogonal projector onto RCA^), 

3. P A ± =I-P A is the orthogonal project onto N(A), 
where A f is the Moore -Penrose pseudo -inverse. 

Theorem 2.2.2 (AXB=Y) 

Let Abe a n z xn 2 matrix, X be a n 2 xn 3 matrix, B be a n 3 xn 4 
matrix, and Y be a n 4 xn 4 matrix. Then the following 
statements are equivalent: 

1. The equation 

AxB=Y (2.64) 

has a solution X. 

2. A, B, and Y satisfy 

P a YP b h=Y. (2.65) 


50 


55 


60 


65 


AX<=X. 


(2.59) 
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3. A, B and Y satisfy 


Pa^Y= 0 , 

(2.66) 

and 


YPgH^ 0. 

(2.67) 


In this case, all solution are of the form 

X=A t YB t +Z-P A H ZP B , (2.68) 

10 

where A f is the Moore-Penrose pseudo-inverse and Z is an 
arbitrary n 2 xn 3 matrix. 

2.3 Linear Matrix Inequalities 

Definition 2.3.1 (Linear Matrix Inequality) 15 

A linear matrix inequality (LMI) has the form 


m 

F(x) = F 0 + ^ j x i F i 


> 0 , 


20 


where xER n is the variable and the symmetric matrices 

F^F/ER"*", i=0, . . . , m, are given. 

The inequality symbol in definition 2.3.1 means that F(x) 25 
is positive definite and the LMI is a strict LMI, but if F(x)^0 
implying that F(x) is positive semidefinite then the LMI is a 
non-strict LMI. Certain nonlinear inequalities can be con- 
verted to a LMI form using Schur Complement. 

30 

Theorem 2.3.1 (Schur Complement) 


The LMI , 


Q{x) S{x) 
S T {x) R(x) 


> 0 , 


(2.69) 


35 


where Q(x)=Q r (x), R(x)=R r (x), and S(x) depend affinely on 
x, is equivalent to 


R(x)> 0, Q(x)>0, Q(x)-S( x^ix^ix) (2.70) 

As an example, the (maximum singular value) matrix 

norm constraint ||Z(x)||<l, where Z(x)ER w and depends 
affinely on x, can be represented as the following LMI, 


I Z(x) 
Z(x) T / 


>0. 


45 


(2.70) 


A standard optimization problem that is encountered is: 5Q 


minimize c T x subject to i 7 (x)>0. 


Appendix B 


Optimal Failure Detection Filters 55 

Current FDI filter design methods are suboptimal with 
respect to noise. One would like FDI filter design to benefit 
from the almost 40 years of Linear Quadratic (LQ) optimal 
design. It has been extensively studied as a design method- 
ology. The reason for such an intense study of the LQ design 60 
methodology is its ease of design and guaranteed properties 
such as sensitivity reduction, gain and phase margins, and 
transient responses. Present FDI filter design methods suffer 
from the lack of the many benefits that LQ design offers. It 
is then of great interest to see if FDI filter design can be cast 65 
as an LQ design problem and then gain the aforementioned 
benefits. 


20 

Using the multivariable Linear Quadratic Regulator 
(LQR) design methodology to obtain desired performance 
metrics has been extensively studied. Harvey and Stein, 
Stein, Kouvaritakis, and Champetier studied the asymptotic 
eigenstructure properties of the LQ regulator, and developed 
algorithms to choose the weights to obtain a desired asymp- 
totic eigenstructure. Researchers, including Anderson and 
Moore, Medanic, Tharp, and Perkins, Kawasaki and 
Shimemura, Chilali and Gahinet, and Shieh, et al., have 
examined the problem of constraining the closed-loop eigen- 
values to a subset of the left-hand plane. 

Many properties of the LQ Estimator (LQE) follow 
directly because it is the dual of the LQR. The body of 
research dealing with the LQ estimation eigenstructure 
problem is surprisingly sparse. Stein looked at the asymp- 
totic left eigenvector eigenstructure of the LQ estimation 
problem as the dual of the LQR problem of right eigenvector 
assignment, and developed an algorithm for specifying the 
asymptotic left eigenstructure in the LQE problem. The LQ 
estimation eigenstructure problem deals with assigning right 
eigenvectors in the LQ estimation problem and its dual, 
assignment of left eigenvectors in LQR. Stengel mentions 
that by adjusting the noise covariance matrices, one can 
achieve different eigenstructures. But he cites Stein’s paper, 
in which only left eigenvectors can be specified, while the 
optimal Fault Detection and Isolation (FDI) problem usually 
requires that the right eigenstructure be specified. Douglas 
and Speyer have developed a left eigenvector approach to 
FDI filter design, but it is not clear that the methods 
developed herein can be combined with that particular 
design methodology because they require the eigenvalues 
associated with the left eigenvectors to be specified. 

The LQ FDI problem is a specialized version of the 
general LQE problem. For the FDI problem, some subset of 
the closed-loop eigenstructure needs to be specified in order 
to achieve failure isolation via direction of the error residual 
vector in the error output space. Park attempted to solve the 
LQ FDI problem. He set up the problem as a minimization 
problem with the trace of the state covariance as the cost 
function, and used Lagrange multipliers to attempt to 
enforce the eigenstructure constraint. He obtained two 
coupled Riccati equations that are “virtually intractable.” 
However, when there was just one failure to detect and the 
detection space was small (one- or two-dimensional), he was 
able to obtain a solution by iterating back and forth between 
the coupled equations. Unfortunately, an examination of 
Park’s solution indicates that the robustness properties of the 
LQ Estimator are not necessarily preserved and thus in some 
situations may not be very robust to uncertainty. 

The general problem of eigenstructure assignment LQE 
problems is analyzed herein. The dual problem of assigning 
eigenstructure in the LQR problem is not covered herein. A 
new algorithm is developed which formulates the LQE 
problem as an LMI optimization problem with an eigen- 
structure constraint. One of the advantages of this formula- 
tion is achieving the desired eigenstructure tolerance not 
asymptotically, but with reasonable weighting matrices that 
correspond to an acceptable value for the feedback gain. 
This new algorithm is then applied to the FDI filter design 
problem, resulting in FDI filters with the desired LQ robust- 
ness properties. The LMI formulation can be solved by any 
of a number of LMI solver packages available. 

5.1 Linear Quadratic Methods, the Riccati Equation, and 
LMI’s 

In order to embed the eigenstructure constraint in the LQ 
optimization problem, it is necessary to cast the LQ problem 
as an LMI optimization problem, to do this, it is first 
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necessary to understand the relationship between the “stan- 
dard” LQ problem, involving the Algebraic Ricatti Equation 
(ARE), and the LQ problem cast as an LMI optimization. 
Once this relationship is understood, it is necessary to 
parameterize the feedback gain so as to ensure the desired 5 
closed-loop eigenstructure is obtained, or to add another 
constraint which enforces the desired eigenstructure align- 
ment. Then, using some results from the inverse LQ 
problem, this constrained gain structure is embedded in the 
LMI optimization problem to guarantee the desired closed- 10 
loop eigenstructure. 

The relationship between the “standard” LQ problem and 
the LMI optimization problem was first presented to the 
controls community by Willems. The power of LMIs is only 
now beginning to be noticed by the controls community. 15 
Doyle said about the usefulness of LMIs that “LMIs play the 
same central role in the post-modern (control) theory as 
Lyapunov function and Riccati equations played in the 
modern, and in turn, various graphical techniques such as 
Bode, Nyquist and Nichols plots played in the classical.” In 20 
his seminal 1971 paper, Willems analyzes linear quadratic 
regulator problem and relates the following equations (the 
duals have been included for completeness), 

1. The Algebraic Riccati Equation (ARE): 

25 

ARE^P^P+PA+Q-PBR-^P, (1) 

mAP+PA T +W-PC T V~ 1 CP 1 (2) 


2. The Quadratic Matrix Inequality (QMI): 
A t P+BA+Q-PERT‘ l B t P^ 0, 

AP+PA T +W-PC T V~ 1 CP ^ 0, 


30 

(3) 

(4) 


3. The Linear Matrix Inequality (LMI): 


LMI : A (P) 


A t P+PA + Q PB 
B t P R 


> 0 , 



AP+PA 7 + W PC 7 
CP V 


> 0 , 


( 6 ) 

40 


Molinari expanded Willem’s detailed analysis and clari- 
fied some additional aspects. An important relationship for 
the work in this dissertation is the relationship between the 45 
solutions of the LMI and the ARE equations. 

To review this relationship consider the LQR problem, 


V(x 0 )= inf f w(x,u)dt, lirnjc(r) = 0, ^ 

usL 2 Jo t ~*°° 

e + 

where 

i^.=/:[0,«)-RlJ ! (t)ei 2 ( O ,D,7-g0 (8) 55 

and x and u are subject to the dynamical constraint 

x = Ax + Bu, (9) 

*(0) = X 0 . 60 


r 


w(x, u)dt+ V(xi) > V(jvo) 


( 10 ) 


for all and x and u satisfying (9) and x(t 1 )=x 1 . In 

differential form, (10) becomes 

V x V(x)(x)^-w(x,u) (11) 

with x=Ax+Bu. For quadratic functions of the form, 


w(x, u ) = [x 7 



X 

u 


(12) 


and R=R r >0 and Q=Q r ^0, the DIE is equivalent to the QMI 
and, using Schur’s complement from Theorem 2.3.1 of 
Appendix A, to the LMI. One can obtain a lower bound on 
the cost, V, in (7) utilizing LMIs. Suppose the quadratic 
function x r Px with P>0 satisfies 

d „ (13) 

— (x 7 Px) > - (x 7 Qx + u 7 Ru ) 
dt 


for all t^0 and for all x and u satisfying the dynamical 
constraint (9). Integrating both sides from 0 to T, one gets: 



x 7 Qx + u 7 Ru dt , 


(14) 


which is a lower bound for V optijnaV Using Schur’s comple- 
ment from Theorem 2.3.1 of Appendix A, another way to 
write (13) is as the LMI: 


a 7 p+pa + q pb 
b 7 p r 


> 0 . 


(15) 


Using these facts and expanding on Willem’s analysis, 
Molinari showed that the maximal and minimal solutions to 
the ARE, P + and P_, are also the maximal and minimal 
solutions to the LMI, thus allowing the solution of the LQR 
problem to be cast as the following LMI optimization 
problem, 


max x^Pxo subject to P> 0, 


a 7 p+pa + q pb 
b 7 p r 


> 0 , 


(16) 


for which fast and numerically stable algorithms have been 
developed in the past 15 years. The optimization variable is 
the symmetric matrix P. Using duality, one can also obtain 
a least upper bound on the optimal cost, V optima i- Consider 
the system (9) with a constant, linear state feedback u=Kx 
that stabilizes the system: 

x=(A+BK)x, x(0)=x o> (17) 

with A+BK stable. Then, the cost function reduces to 


The analysis of this optimization problem leads to the 
series of matrix relations and frequency domain inequalities 
that were previously defined. Furthermore, consider the 

class of functions V: R"->R which satisfy the dissipation 
inequality (DIE) 


V(xq) = inf f x 7 (Q + K T RK)xdt. 
usL 2e+Jo 

From standard results, V can be evaluated as 

TrZ(Q+K r/wc ), 


(18) 


(19) 
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where Z satisfies 

(A+BK)Z+Z(A+BK) t +x oX o t =0, 


24 

ing to align the closed-loop eigenstructure in a specified 
manner. The return difference equation for the LQ estimator 

( 2 °) is 


with A+BK stable. Thus, the least upper bound on V 0/)riW , 
using state-feedback control, can be computed as the solu- 
tion to the optimization problem with the optimization 
variables Z and K: 


min TrZ(Q+K r RK), 
subject to 

Z>0,(£+BK)Z+Z(A+BK) T +xjc o T ^ 0, 


10 


( 21 ) 


The dual of the LQR problem is the LQE problem. Consider 
the system 

x=Ax+Bu+Gw, (22) 


y=Cx+v, (23) 

where w(t) is white noise with intensity W, v(t) is white 
noise with intensity V, and w(t) and v(t) are uncorrelated. 
The LQ estimator has the associated Algebraic Riccati 
Equation: 


AP+PA T +GWG T -PC T V 1 CP=Q. 

(24) 25 

optimal observer is: 


x=Ax+Bu+L (y-Cx), 

(25) 

where 

30 

L=PC r V~ 1 . 

(26) 


The ARE associated with the LQ estimator problem can be 
turned into the following LMI: 


LMI : A (P) 


AP+ PA t + GWG t PC 7 
CP V 


> 0 . 


(27) 


The benefits of formulating the LQ problem as an LMI, 
which were pointed out in Appendix A, could not be realized 
until relatively recently. Within the last 5 to 10 years, the 
efficient numerical algorithms for solving LMIs developed 
in the early to mid-1980s were coded and released to the ^ 
general research audience. Research into LMI solvers and 
improvements to the LMI solver codes will continue to 
make this formulation even more attractive in the future. The 
three main advantages to casting the LQ problems as LMI 
optimizations are, 

1. The optimization problem can be solved in polynomial- 
time, 

2. The optimization problem can be solved in practice 
very efficiently, and 

3. Feasible linear constraints and feasible nonlinear con- 55 
straints of a special form (using Schur’s complement) 
can easily be added to the optimization problem. 

5.2 Least Squares LMI LQE Eigenstructure Assignment 

The goal is to develop an algorithm using LMIs to obtain 
a solution that is optimal for some P, GWG r , and V thus 60 
preserving the attractive robustness properties of the LQ 
estimator and at the same time align the eigenstructure in 
some desired manner. Additionally, we would like to achieve 
this with the closed-loop poles in a “reasonable” region of 
the left-hand plane. 65 

An analysis of the observer return difference equation 
helps to understand the constraints associated with attempt- 


T(s)Vr r (-s)=V+C(sI=A)~ 1 GWG T (-sI-A T )~ 1 C r . (28) 

Eigenvectors of this equation are the closed-loop eigen- 
vectors of the system. Thus, the choice of G, W, and V 
determine the closed-loop eigenstructure. Perfect eigen- 
structure alignment is not necessary in the real world. A 
simple bound on the error in the eigenstructure alignment 
would be sufficient for any realistic application. Given a 
desired set of eigenvectors (or detection space), X cl , and 
their unknown (will be determined later) associated 
eigenvalues, L, a least square representation of this align- 
ment constraint is: 

e > ||(A/ - A 4 - PC T V~ 1 C)X c i\\\. (29) 


The bound E is a free parameter chosen by the designer. 
It can be viewed as a weight on how tight the actual 
eigenstructure alignment has to be which is determined by 
the post-processing performance requirements. A very small 
E essentially aligns the eigenstructure exactly. The con- 
straint can be turned into an LMI using Schur’s complement 
and has the form: 


si {(Xi - a + per 1 C)x cl y 

i 


(30) 


(XI - A + PC 7 V~ l C)X c [ 


>0. 


The value of E needed to obtain a prescribed level of 
alignment is dependent on the closed-loop eigenvalues asso- 
ciated with the desired closed-loop eigenvectors. This is 
because the closed-loop eigenvalues scale the misalignment 
error. If the choice of E results in an alignment that does not 
meet the required alignment tolerance, a lower value can 
always be chosen and the optimization problem rerun. 
Because V -1 appears in (30), the choice of V is fixed. Also, 
G appears quadratically, so it is fixed. However, W is still 
free and if there is sufficient freedom in the choice of W, then 
the desired eigenvectors can be assigned. 

In addition to the eigenstructure alignment, it is important 
that the estimator does not have poles that are too fast and 
track the noise inherent in any physical system. Additionally, 
this constraint will be a primary factor in determining the 
Butterworth pattern that the non-finite closed-loop modes 
take. This constraint draws on a result from Chilali and 
Gahinet. 


Definition 5.2.1 D-Stable System 
A system x=Ax is called D-Stable if all its poles line in D. 

Definition 5.2.2 LMI Regions 

A subset D of the complex plane is called an LMI region 
if there exists a symmetric matrix aER mxm and a matrix 
pEi l mxm such that 

D={zEE C:f D <0}, (31) 


with 

;(V=a+zp+z-p r (32) 
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Theorem 5.2.1. D-Stable LMI Constraint 

The matrix A is D -stable if and only if there exists a 
symmetric matrices P, a, and (3 such that 


M D (A,P):=a@P+$@ (AP)+(5 r © ( AP) 7 , 

(33) 

M d (A,P) <0,P>0 . 

(34) 


26 

Theorem 5.2.2. Least Squares Optimal Detection 
Filter 

Given the system: 

5 x=Ax+Bu+Gw, (39) 

y=Cx+v, (40) 

x(0)=x o . 


To illustrate the implications of this property, consider the 
vertical strip defined by: 

D=(o+jwE.C :-h<o< 0) (35) 


io and assuming (A,G) stabilizable and (A,C) detectable, then 
the maximal solution to the LMI optimization problem in the 
variables P=P 7 >0, W=W r >0, and -h<L<0, is: 


max x 7 Pxq, 


A r P+PA+2hP> 0 


(36) 


15 


Applying this condition and using Schur’s complement 
results in the following LMI: 


subject to 


20 


AP+PA T +2hP PC T 
CP 1/2V 


>0. 


(37) 


AP+ PA t + GWG t PC 7 
CP V 


> 0 , 


(41) 


(42) 


This LMI constraint allows the engineer to specify a bound 25 
on the fast poles of the closed-loop system. 

The variables, V and W in (28) specify the LQ estimator 
closed-loop eigenstructure. From (30) it is clear that to 
preserve the problem as a linear optimization problem, V 
and G must be fixed. Fortunately, W can still be matrix 30 
variable and preserve the problem as a linear optimization 
problem. Additionally, all the choice of G accomplishes is to 
determine the null space of the GWG r matrix. In the 
estimator problem, the null space of this matrix specifies the 
directions of the finite zeros of the observers. The poles of 35 
the estimator associated with the range space of GWG r will 
head off in a yet undetermined Butterworth pattern. This 
Butterworth pattern will be determined by the matrix vari- 
able W which is found by the solution of the optimization 
problem. 40 

This does bring to light a shortcoming of the proposed 
algorithm. The constraints must be given as strict, not 
non-strict, inequalities. By specifying G, the rank of GWG r 
is predetermined. The LMI solver algorithms all work with 
strict inequality, because finding the rank of a matrix is not 45 
a well defined problem. If this were not the case, then a new 
matrix variable Q=GWG r could be introduced and the 
optimization algorithm could determine the optimal range of 
Q. When computing the solutions, the strict inequalities are 50 
essentially the same as non-strict ones to machine precision, 
but many of the theoretical results rely on (the greater than 
or equal) inequality instead of the strict inequality. The LMI 
solvers will view a matrix with an eigenvalue of L^IO -15 as 
>0, but for all practical purposes the matrix is ^0. In order 55 
to do this, W can be allowed to be a free variable, but G must 
be chosen. The choice of G determines the range of GWG r 
since W is constrained to be full rank. The resulting LMI is: 


AP + PA 7 + 2hP PC 7 
CP l J2V 


>0. 


(43) 


si {(XI - A 4- PC 7 V~ l C)X c i) 

I 


(44) 


(XI - A + PC 7 V~ l C)X c i 


>0. 


A solution with all the standard robustness properties to the 
asymptotically stable time-invariant Linear Quadratic Esti- 
mator problem with eigenvector alignment within E of the 
desired eigenvectors X cl and poles at most h distance into the 
left-half plane. 


Proof 

From (13) it is clear that solutions to (41) are defined by 
(42). The dual of (42) is (15). Now assume where 

P* satisfies (15). Using the relations (10) through (14) it 
follows that: 


rb 

A 7 P+PA 7 + H t WH PB 

o 

II 

K 

u [ajy] J a 

b 7 p R 


X 

u 


dt, V x(a ) 


(45) 


Now define 


K^RtWP, 

(46) 

A.=A-BK ♦, 

(47) 

then using (2) and (5) and the identity 


A ( p*) = f 7 °| 7 °i 

U* / JL o JL a:* / J 

(48) 


AP+PA 7 + GWG 7 
CP 


PC 

V 


> 0 , 


(38) 


60 one obtains 


where the variables are now P, W, and the X in (29) is the 
pole associated with the desired eigenspace. This is now a 
FDI filter design problem and the desired eigenspace, X cl , is 
the detection space. 


= inf 
u [aM 


f 


||Lx|| 2 + 1|/? 1/2 v|| 2 dt , for all x(d). 


(49) 


65 


where r(P*)=L r L and the feedback law is v=K*x+u. This is 
the standard nonsingular LQR problem, and it achieves its 
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infimum over the space of continuous functions. Immedi- 
ately v°sO and Lx°sO. Since this is true for all x(a), then 
LsO. Thus, the solution to the optimization problem (41) is 
also a solution to: 

Ai?E.T(P)=0. (50) 

It follows by duality that the solution to (41) is also a 
solution to the estimator ARE, 

ARE : T (P) =AP+PA r +G WG T -PC T V~ 1 CP=0 . (51) 

Furthermore, the solution to (41) as solutions to the ARE 
also have all the attractive robustness properties of the 
nominal LQE. However, the solutions of (41) also satisfy the 
other constraints, (43) and (44), ensuring that the desired 
eigenstructure is aligned to within e and all the closed-loop 
poles are at most h into the left-half plane. 

The detectability requirement ensures that the closed-loop 
system is asymptotically stable. If an unstable mode does not 
show up in the cost of the optimization problem, there is no 
guarantee of stability. In certain cases, such as when the 
system is asymptotically stable to begin with, or with a 
modification to the optimization problem, the detectability 
requirement can be dropped. Using duality and the detailed 
analysis given in Zhou and Doyle for what they term the 
“extended LQR” problem explains when these requirements 
can be dropped. Anderson and Moore give a clear explana- 
tion of the detectability requirement as applied to the ARE. 
The robustness properties also follow from the fact that the 
LMI solutions are solutions to the ARE. Starting with the 
ARE 

AP+PA t -LVL t +GWG t = 0. (52) 

Then add and subtract sP to both sides to get 

-(sI-A)P-P(-sI-A t )-LVL t +GWG t =Q. (53) 

Then multiply from the left by C(sl-A ) -1 and from the right 
by (-sI-A 7 ) -1 ^ to get 


5.3 Direct Optimal Detection Filter Design 

Stein developed an LQ filter design algorithm for closed- 
loop asymptotic eigenstructure alignment. It required the 
designer to specify left eigenvectors and eigenvalues for the 
5 closed-loop estimator. Unfortunately, this is not the design 
problem that needs to be solved for detection filters. Return- 
ing to the LQ Estimator problem, in equation (2.40) of 
Appendix A the estimator feedback was parameterized as 
function of the desired closed eigenstructure, X cl and the 
10 associated eigenvalues, and the free gain matrix, E. 

By specifying the closed-loop eigenvalues, though, the 
designer is not making use of all the flexibility offered by 
multivariable feedback. However, the desired eigenvector 
alignment does impose structural constraints on the feed- 
15 back gain. One can look at the structural constraints placed 
on the estimator feedback gain when attempting to specify 
some part of the closed-loop eigenstructure. Consider a 

subspace, X c/ E Rf, that a designer would like to specify as 
part of the closed-loop eigenstructure. To be even more 
20 strict, the designer would like any one -dimensional subspace 

of X c/ ER 7 ' to be part of the closed-loop eigenstructure. In 
the case of an FDI filter design, this would ensure the 
detection spaces are closed-loop eigenvectors. Thus, each of 
25 the nxl column vectors in X c/ are closed-loop eigenvectors 
of the system. The set of equations, 


M<kAX cr X cl £ ch 


S cr diag(k x , k 2 , . . . , k p ). (61) 

describe the constraints on the estimator feedback gain. 
35 Specifically, in the FDI filter problem, X c/ is the desired 
detection space. The solution of (58) for the state estimator 
gain L will be referred to as the State Estimator Gain (SEG) 
problem. The SEG structural constraints arise due to Theo- 
rem 2.2.2 of Appendix A. The solution to the SEG equation 


l=mn*+zp n 


C(sl - A)~ l GWG T (-sI - A t ) l C T = 0. 


Using the fact that L^-PCT^V 1 then 


(2.67) in Appendix A requires that 

M(I-N^N)=0, 

(AX cr X cr X cl Sj(I-N*tf))=0, 


VlJ (-si - A T )~ l C T + C(sl - A)~ l LV - 

C(sl - A)~ l LVlI (-si - A T )~ l C t + 


C(sl - A)- l GWG T (-si - A t )~ 1 C t - 0. 


50 thus (2.67) in Appendix A is easily satisfied, since N f N=I. 
(2.65) in Appendix A imposes the last constraint 


Completing the square results in 


v + C(sl - A)~ l gwg t (-si - a t )~ 1 c t 


(I - C(sl - A)- l L)V(l - L T (-si - A T )~ l C T ), 


and is easily satisfied. An advantage of the new parameter- 
ization is that S c/ can potentially take another form. If the 
sub -partitions of S c/ take the form, 


(/-C(s/-A)-T) V(I-L t (-sI-A t )- 1 C t )^I. 


Real( A) -Imag( A)' 
Imag( A) Recd( A) 


_ The ability to preserver the robustness properties then the subset of the subspace X c/ associated with that 

a||S(jw)||^l, of the LQ Estimator is an important aspect of 65 particular sub=partition of S c/ is a pair of complex conjugate 
the new design method. For the first time, it allows the eigenvalues. An advantage of this is that in some cases the 

design of detection filters with guaranteed robust properties. restriction that eigenvalues associated with X c/ be real may 
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eliminate an important degree of design freedom. Already 
some degree of design freedom have been eliminated 
because of the eigenvector constraint. In some cases, asso- 
ciating a pair of complex conjugate eigenvalues with the 
desired subspace X cl may result in a better design. The SEG 
parameterization can then be written as: 

L = AX cl ((CX cl f (CX cl )r'(CX cl ) T + < 69 > 

X c ,S cl ((CX cl ) T (CX cl ))-'(CX cl ) T + 

W - ( cx c i)((cx c i) r (cx ct y l 2 3 4 ( cx c if ) 

= L 0 + X cl LjC p + L k c; (70) 


Lo = AXMCX cl f(CX cl ))-\cX c 0 T , 


c=y- 1 [io]z- 


g(n-m)x(n-m) 


L -L o + X ci L jC p +L k C p 


Assume that the LQ estimator problem has an optimal 
( 73 ) solution for (A, C, Q). Then there exists a real symmetric 
matrix P such that 


where EER mxn is an mxn arbitrary matrix. An analysis of 
this gain parameterization shows that the L 0 gain sets up part 
of the closed-loop system, A-L 0 C, to have the desired 
eigenvectors and eigenvalues of 0. The L diagonal matrix ^ 
sets the eigenvalues in the desired eigenspace (or the detec- 
tion space, in FDI theory). The L k matrix determines the 
eigenstructure in the remaining unspecified closed-loop sub- 
space (or the completion space, in FDI theory). This param- 
eterization is similar to Park’s parameterizations, but is 3Q 
derived differently. 

Given a parameterized gain, can one say anything about 
the parameterization of the solution of the LMI? This is a 
different form of the inverse optimal control question. The 
inverse multivariable optimal control problem, first thor- 35 
oughly analyzed by Anderson and elaborated on by 
Molinari, asks whether, given a stabilizing gain, K, there is 
a non-negative matrix P and an associated family of Q’s and 
R’s that give that answer as a solution to the LQR problem. 
This is essentially a subset of what we have. We would like 40 
to know whether, given a parameterized estimator gain L, 
we can obtain a parameterized family of P, W’s and V’s 
where that parameterized L is a solution to the LQ estima- 
tion problem. 

If one assumes V=I, then the solution P can be param- 45 
eterized by the set of free parameters in the gain matrix plus 
an additional set of free parameters. Given this parameter- 
ization of the solution, P, there is an equation that places a 
restriction on the choice of W. The following analysis 
borrows heavily from Molinari and the fact that the LQ 50 
regulator problem and the LQ estimator problems are duals 
as far as stability and eigenvalue placement. 

Theorem 5.3.1. Inverse LQ Estimator Problem 

55 

Assume that (A, C) is detectable and (A, Q 1/2 ) 
stabilizable, where Q=GWG r . Then Lis optimal for Q if and 
only if 

1. ReL(A-LC)<0 and X cl is part of the set of closed-loop 60 
eigenvectors. 

2. L-PC^Lo+X^LyCp+L* C ^ for some real symmetric 
P^O, 

3. AP+PA r -L r L+Q=0, 

4. CL is a symmetric matrix, where P is a function of the 
gain L and an arbitrary matrix SER (n_m)x(n_m) and is 


ap+pa-pc t cp+q= o, 

ReX{A-LC)< 0, 


Thus, conditions (l)-(3) are satisfied by P. Conversely, 
should (l)-(3) hold, then clearly P is a real symmetric 
solution of the ARE satisfying ReL(A-LC)<0. Of necessity, 
this P is unique, and can be denoted P. Thus, L is optimal for 
Q. Given (l)-(3), hence an optimal L, then (4) follows from 
the fact that CL=CPC r for a symmetric P. Conversely, C 
admits the representation 

C=Y^ 1 [/0]Z -1 , (81) 

where Y and Z are non-singular. Next, consider the parti- 
tioned matrix 


Thus, for an arbitrary symmetric matrix S (n m)x( ” m \ 


YCLY Y 1 D 2 

p - z zF 

D 2 Y ^(n-ffj)x(n-ffi) 


From this (1) and (2) are satisfied and L is optimal for the 
Q which is the solution to (3). 

Using this theorem, an LMI optimization problem that 
solves the LQ estimator with eigenstructure alignment prob- 
lem can now be posed. Th variables are the gain matrices, L 
and 4, the arbitrary positive definite symmetric matrix S, 
and positive definite symmetric matrix W. 

Theorem 5.3.2. Direct Optimal Detection Filter 
Given the system 

x=Ax+Bu+Gw, (85) 


and assume that (A, C) is detectable and (A, G) stabilizable. 
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max^o Pxq, 


( 88 ) 


subject to 


AP + PA 7 • GWG 7 PC 7 
CP / 


> 0 , 


AP+PA 1 +2hP PC 1 
CP 1/2/ 


> 0 , 


P = Z\ 


YCLY 7 Y t D 7 2 

D 2 Y g(n-m)x{n-m) 


(89) 


10 


(90) 


15 


(91) 


20 


L=L 0 X cl L j C p +L lc C p L 
c = y~ 1 [i o]zr l ,zr l L= j^ 1 1 


(92) 

(93) 


25 


P=P T >0,W=W T >0, and 5=5 r >0. (94) 

Proof 30 

Using duality and Theorem 5.2.2, the solution to (88) is 
also a solution to the ARE. Thus, using the same arguments 
as in Theorem 5.2.2, the solution to (88) has all the attractive 
robustness properties of the nominal Linear Quadratic Esti- 35 
mator in addition to having no poles more than h into the 
left-half plane, and has X cl as part of the set of closed-loop 
eigenvectors. 

The main disadvantage of the direct method is the V=I 
assumption. The feedback gain parameterization and P 40 
matrix parameterization guarantee that the closed-loop sys- 
tem has the desired eigenstructure. However, one could also 
find a solution to the Optimal Detection Filter optimization 
problem by using the least squares approach used in Theo- 
rem 5.2.2. The requirement that V=I can then be relaxed to 45 
V=V 7 >0 for the least squares method. 

In many situations, these two optimizations problems 
return identical answers. However, they seem to perform 
differently under different constraint conditions. Condition 3 
of theorem 5.3.2 clearly indicates that the choice of G puts 50 
significant restrictions on the freedom in W. When the row 
rank of G is lower, i.e., the number of outputs few, the latter 
least squares optimization problem returns a solution that is 
better. The term “better” applies as follows: The LMI solver 
exits on a number of conditions, including when it cannot 55 
get any closer to a feasible solution. In this case, a check of 
the sensitivity function’s singular values will indicate the 
solution does not satisfy the LMI associated with the Riccati 
equation. Also, a check of the closed-loop eigenvectors may 
indicate the alignment exceeded the tolerance E. Generally, 60 
if the LMI fails to converge, then it is necessary to check 
these two things in addition to the general closed-loop 
stability (the locations of closed-loop eigenvalues) to see 
what the solution is. When the number of outputs is 
sufficient, the “structured gain” LMI optimization approach 65 
works better to reduce the fast pole location bound. Also, the 
parameterized gain approach always has the desired eigen- 
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structure. The best results are obtained when both optimi- 
zation problems work. This gives some guidance on the 
choice of G and the “reasonable” choice of the fast pole 
constraint value h. Using the LMI solver package written by 
E. Ghaoui et al. and the SDPPACK solver, the Twin Otter 
Estimation with eigenstructure alignment was solved. In this 
case, the “least-squares” method returned an alignment error 
of 1.3°. The parameterized method exactly assigned the 
desired eigenvector. The different values for the trace of P 
differed by only 0.04, and the eigenvalues were also essen- 
tially the same. Finally, the attractive robustness properties 
were preserved in that with both solutions the sensitivity 
functions never exceeded 1. 
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55 While embodiments of the invention have been illustrated 
and described, it is not intended that these embodiments 
illustrate and describe all possible forms of the invention. 
Rather, the words used in the specification are words of 
description rather than limitation, and it is understood that 
60 various changes may be made without departing from the 
spirit and scope of the invention. 

What is claimed is: 

1. A method for detecting a failure or performance deg- 
radation in a dynamic system having sensors for measuring 
65 state variables of the system and providing corresponding 
output signals in response to at least one system input signal, 
the method comprising: 
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calculating estimated gains of a filter and selecting an 
appropriate linear model for processing the output 
signals based on the at least one system input signal, the 
step of calculating utilizing at least one model of the 
dynamic system to obtain estimated signals; 5 

calculating output error residuals based on the output 
signals and the estimated signals; and 

detecting at least one hypothesized failure or performance 
degradation of a component or subsystem of the 
dynamic system based on the error residuals, wherein 10 
the step of calculating the estimated gains is performed 
optimally with respect to one or more of: noise, uncer- 
tainty of parameters of the at least one model and 
un-modeled dynamics of the dynamic system. 

2. The method as claimed in claim 1 wherein the step of 
calculating estimated gains is performed continually. 

3. The method as claimed in claim 1 wherein the dynamic 
system is a closed-loop dynamic system. 

4. The method as claimed in claim 1 further comprising 
generating a signal for each hypothesized failure or perfor- 
mance degradation and storing each signal in a database for 20 
subsequent retrieval. 

5. The method as claimed in claim 1 further comprising 
generating a signal for each hypothesized failure or perfor- 
mance degradation and processing each signal to diagnose 
the at least one hypothesized failure or performance degra- 25 
dation. 

6. The method as claimed in claim 1 further comprising 

generating a signal for each hypothesized failure or perfor- 
mance degradation and processing each signal to obtain a 
reconfiguration signal. 30 

7. The method as claimed in claim 6 wherein the dynamic 

system has a controller and wherein the method further 
comprises reconfiguring the controller based on the recon- 
figuration signal to compensate for the at least one hypoth- 
esized failure or performance degradation. 35 

8. The method as claimed in claim 7 wherein the at least 
one hypothesized failure or performance degradation is a 
failure or degradation of one of the sensors. 

9. The method as claimed in claim 8 wherein the recon- 
figuration signal inserts an estimated or compensated value 40 
of the output signal of the failed or degraded sensor into the 
controller. 

10. The method as claimed in claim 6 wherein the 
dynamic system has a controller and at least one actuator and 
wherein the method further comprises reconfiguring the 45 
controller based on the reconfiguration signal to compensate 
for a change of the at least one actuator. 

11. The method as claimed in claim 1 wherein the 

dynamic system is a flight vehicle and the sensors include 
flight control sensors. 50 

12. The method as claimed in claim 1 wherein the 

dynamic system is a physical system characterized by a 
nonlinear dynamic model having parameters and wherein 
changes in the dynamic system are manifest by parameter 
changes in the nonlinear dynamic model. 55 

13. The method as claimed in claim 1 wherein the error 
residuals are propagated in a unique direction in output 
detection space for a given hypothesized failure or perfor- 
mance degradation. 

14. The method as claimed in claim 1 wherein the step of 60 
calculating estimated gains includes the step of controllably 
selecting parameters of the at least one model. 

15. The method as claimed in claim 1 wherein the step of 
detecting detects intermittent faults. 

16. The method as claimed in claim 13 wherein the step 65 
of detecting is based on magnitude and direction of the error 
residuals in the detection space. 
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17. The method as claimed in claim 1 wherein the at least 
one model includes non-dimensional variables and wherein 
the step of detecting includes the step of converting from the 
non-dimensional variables to dimensional variables to 
obtain re-scaled error residuals and wherein the step of 
detecting is also based on the re-scaled error residuals. 

18. The method as claimed in claim 1 wherein a plurality 
of mathematical models are utilized to model the dynamic 
system and wherein the step of calculating estimated gains 
includes the step of selecting one of the plurality of math- 
ematical models. 

19. A detection system for detecting a failure or perfor- 
mance degradation in a dynamic system having sensors for 
measuring state variables of the dynamic system and pro- 
viding corresponding output signals in response to at least 
one system input signal, the detection system comprising: 

means for calculating estimated gains of a filter and 
selecting an appropriate linear model for processing the 
output signals based on the at least one system input 
signal, the means for calculating utilizing at least one 
model of the dynamic system to obtain estimated 
signals; 

means for calculating output error residuals based on the 
output signals and the estimated signals; and 

means for detecting at least one hypothesized failure or 
performance degradation of a component or subsystem 
of the dynamic system based on the error residuals, 
wherein the means for calculating the estimated gains 
calculates optimally with respect to one or more of: 
noise, uncertainty of parameters of the at least one 
model and un-modeled dynamics of the dynamic sys- 
tem. 

20. The detection system as claimed in claim 19 wherein 
the estimated gains are calculated continually. 

21. The detection system as claimed in claim 19 wherein 
the dynamic system is a closed-loop dynamic system. 

22. The detection system as claimed in claim 19 further 
comprising means for generating a signal for each hypoth- 
esized failure or performance degradation and a database for 
storing each signal for subsequent retrieval. 

23. The detection system as claimed in claim 19 further 
comprising means for generating a signal for each hypoth- 
esized failure or performance degradation and means for 
processing each signal to diagnose the at least one hypoth- 
esized failure or performance degradation. 

24. The detection system as claimed in claim 19 further 
comprising means for generating a signal for each hypoth- 
esized failure or performance degradation and means for 
processing each signal to obtain a reconfiguration signal. 

25. The detection system as claimed in claim 24 wherein 
the dynamic system has a controller and wherein the detec- 
tion system further comprises means for reconfiguring the 
controller based on the reconfiguration signal to compensate 
for the at least one hypothesized failure or performance 
degradation. 

26. The detection system as claimed in claim 25 wherein 
the at least one hypothesized failure or performance degra- 
dation is a failure or degradation of one of the sensors. 

27. The detection system as claimed in claim 26 wherein 
the reconfiguration signal inserts an estimated or compen- 
sated value of the output signal of the failed or degraded 
sensor into the controller. 

28. The detection system as claimed in claim 24 wherein 
the dynamic system has a controller and at least one actuator 
and wherein the detection system further comprises means 
for reconfiguring the controller based on the reconfiguration 
signal to compensate for a change of the at least one actuator. 
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29. The detection system as claimed in claim 19 wherein 
the dynamic system is a flight vehicle and the sensors 
include flight control sensors. 

30. The detection system as claimed in claim 19 wherein 
the dynamic system is a physical system characterized by a 
nonlinear dynamic model having parameters and wherein 
changes in the dynamic system are manifest by parameter 
changes in the nonlinear dynamic model. 

31. The detection system as claimed in claim 19 wherein 
the error residuals are propagated in a unique direction in 
output detection space for a given hypothesized failure or 
performance degradation. 

32. The detection system as claimed in claim 19 wherein 
the means for calculating estimated gains includes means for 
controllably selecting parameters of the at least one model. 

33. The detection system as claimed in claim 19 wherein 
the means for detecting detects intermittent faults. 

34. The detection system as claimed in claim 31 wherein 
the means for detecting detects based on magnitude and 
direction of the error residuals in the detection space. 
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35. The detection system as claimed in claim 19 wherein 
the at least one model includes non-dimensional variables 
and wherein the means for detecting includes means for 
converting from the non-dimensional variables to dimen- 

5 sional variables to obtain re-scaled error residuals and 
wherein the means for detecting detects based on the 
re-scaled error residuals. 

36. The detection system as claimed in claim 19 wherein 
a plurality of mathematical models are utilized to model the 

10 dynamic system and wherein the means for calculating 
estimated gains includes means for selecting one of the 
plurality of mathematical models. 

37. The method as claimed in claim 1 wherein the 
dynamic system is a financial market or modeled financial 

15 system. 

38. The detection system as claimed in claim 19 wherein 
the dynamic system is a financial market or modeled finan- 
cial system. 



